Application of Reinforcement Learning Algorithms for Predicting Taxi-out Times
نویسندگان
چکیده
Accurate estimation of taxi-out time in the presence of uncertainties in the National Airspace System (NAS) is essential for the development of a more efficient air traffic management system. The dynamic nature of operations in the NAS indicates that traditional regression methods characterized by constant parameters would be inadequate to capture variations in taxi-out time across a day. In this paper, we describe how to build a taxiout time estimation model using Reinforcement Learning, and identify factors that influence taxi-out time through the day. Taxi-out time predictions for a flight are made 15 minutes in advance of scheduled gate pushback time. Results from a case study of Detroit International Airport (DTW), Tampa International Airport (TPA), and John F. Kennedy International Airport (JFK) are presented and analyzed. Keywords-taxi-out time estimation; reinforcement learning; air transportation system
منابع مشابه
Taxi-out Prediction using Approximate Dynamic Programming
High taxi-out times (time between gate push-back and wheels off) at major airports is a primary cause for flight delays in the National Airspace System (NAS). These delays have a cascading effect and affect the performance of Air Traffic Control (ATC) System. Accurate prediction of taxi-out time is needed to make downstream schedule adjustments and better departure planning, which mitigates del...
متن کاملA Stochastic Dynamic Programming Approach to Taxi-out Prediction Using Reinforcement Learning
This research is driven by the critical need for a technological breakthrough in taxi-out prediction, and intelligence-based decision making capabilities for an airport operating system. With the advent of sophisticated automation, the use of information-driven intelligent decision support system (IIDSS) to control service operations such as airport has become a necessity to ensure efficiency a...
متن کاملTaxi-Out Time Prediction for Departures at Charlotte Airport Using Machine Learning Techniques
Predicting the taxi-out times of departures accurately is important for improving airport efficiency and takeoff time predictability. In this paper, we attempt to apply machine learning techniques to actual traffic data at Charlotte Douglas International Airport for taxi-out time prediction. To find the key factors affecting aircraft taxi times, surface surveillance data is first analyzed. From...
متن کاملAn Extension of a Hierarchical Reinforcement Learning Algorithm for Multiagent Settings
This paper compares and investigates single-agent reinforcement learning (RL) algorithms on the simple and an extended taxi problem domain, and multiagent RL algorithms on a multiagent extension of the simple taxi problem domain we created. In particular, we extend the Policy Hill Climbing (PHC) and the Win or Learn Fast-PHC (WoLF-PHC) algorithms by combining them with the MAXQ hierarchical dec...
متن کاملReinforcement Learning in Neural Networks: A Survey
In recent years, researches on reinforcement learning (RL) have focused on bridging the gap between adaptive optimal control and bio-inspired learning techniques. Neural network reinforcement learning (NNRL) is among the most popular algorithms in the RL framework. The advantage of using neural networks enables the RL to search for optimal policies more efficiently in several real-life applicat...
متن کامل